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ABSTRACT 

Here we describe an “information based exchange” model of brain function that ascribes to 
neocortex, basal ganglia, and thalamus distinct network functions. The model allows us to 
analyze whole brain system set point measures, such as the rate and heterogeneity of transitions 
in striatum and neocortex, in the context of disease perturbations. Our closed-loop model 
invokes different forms of plasticity at specific tissue interfaces and their principle cell synapses 
to achieve these transitions. By modulating information based exchange of action potentials 
between modeled neocortical areas, we observe changes to these measures in simulation. We 
hypothesize that similar dynamic set points and modulations exist in the brain’s resting state 
activity, and that germ line modifications of information based exchange may increase the risk of 
diseases such as Huntington’s, Parkinson’s, and Alzheimer’s. Disturbances in synaptic plasticity 
at distinct tissue interfaces in the model may be used to estimate risks of system dysfunction 
and neuronal cell death from quantitative analyses of the global dynamics that maintain system 
set points. The model is targeted for further development using IBM’s Neural Tissue Simulator, 
which allows scalable elaboration of networks, tissues, and their neural and synaptic components 
towards ever greater complexity and biological realism. Elaboration of these simulations within 
each modeled neural tissue allows in silico study of therapeutic interventions in living brain tissue. 
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1 INTRODUCTION 


Synaptic plasticity regulates neuronal responses to patterns of inputs impinging on dendritie arbors from 
multiple presynaptie sourees. Resulting input seleetivity is often assoeiated with learning and memory: 
eognitive funetions often redueed at the single neuron level to simple input-output eategorizations. At the 
eireuit level, synaptie plastieity ean serve more eomplex funetions over arbitrary inputs, from seleeting 
fixed points in reeurrent networks |Hopfield]|1982| , to implementing optimizations sueh as information 
maximization in artifieial neural networks [ Linsker[ 19971, to dynamieal eneoding by winnerless networks 
[Rabinovieh et al. 20011. A ehallenge to analyzing the role of any neuron or eireuit that implements these 
funetions for eognition is that of modeling appropriate, naturalistie neuronal and eireuit inputs, whieh in 
real brains derive from tens of thousands to millions of other neurons. 


Here we present a elosed-loop brain model, ineluding eomponent models of several neural tissues that 
we hypothesize implement some of these funetions. Synapses and plastieity eonneeting components at 
prineiple eell interfaees together ereate a set of elosed neuroanatomieal loops. Without extrinsie inputs 
or stoehastie intrinsie drivers, our model avoids the ehallenges and assumptions of modeling naturalistie 
inputs separately, and instead derives them exelusively from the dynamies of upstream neurons and tissues 
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within the model’s elosed loops. The ehallenge then is model validation, whieh we won’t address in this 
report. Instead the aim here is to delineate hypotheses and a theory of brain resting state funetion using 
the model and its simulations. We propose that models implemented similarly eonstitute a elass of “brain 
models,” and are distinet from eomponent “neural tissue models,” whieh instead must assume a set of 
inputs or stoehastie proeesses to drive intrinsie tissue dynamies. In this way, a eoarse but eonsistent model 
of global brain funetion may be useful for eonstraining the most detailed neural tissue simulations. 


We introduee the term “traversal” to refer to a “synhre ehain” as dehned by Abeles [ Abeles 1991[ , but 
with additional neuroanatomieal eonstraints defining a minimum set of neoeortieal regions traversed by 
the event. The eortieo-eortieal feedbaek loop in our model aets as a substrate for eombined traversals 
of sensory, limbie, and motor areas, whieh we propose together drive behavior in the organism. The 
eortieo-thalamo-eortieal feed forward loop aets to maximize the entropy of these global traversals and 
to maximize information about the environment relayed as inputs to the loop. Lastly, the striato-nigro- 
striatal loop provides a means to seleet subsequent eonfigurations by monitoring ehanges in ongoing 
traversals and signaling them with dopamine to alter routing within the feed forward entropy maximizing 
network. We propose this funetion as the substrate for reward learning in the organism. Eaeh of these loops 
therefore has both a elosed-loop funetion (global traversal, traversal entropy maximization, and traversal 
ehange monitoring and rerouting) and an organismal input-output funetion (behavior generation, sensory 
proeessing, and behavior seleetion based on reward learning). 


The objeetive of this report is to deseribe the elosed-loop model and simulations of it, and how we 
hypothesize about dynamie disease meehanisms and progression based on them. Furthermore, methods for 
modeling treatments that alter brain disease risks using neural tissue simulation | Kozloski and Wagner[ 


20111 and perturbations to the elosed loop that alter dynamie set points will also be deseribed. To summarize 


our overall approaeh, the driving hypotheses for brain disorder and disease that we aim to delineate using 
the model are: 1. The primary disease and disorder risk is a disturbanee in plastieity that eritieally maintains 
brain system dynamie set points; 2. Compensatory eireuit dynamies aehieves near-normal set points despite 
genetie or environmental perturbations, but with inereased seeondary risk of neuronal dysfunetion, damage, 
or loss; 3. Seeondary risk eorrelates with feed forward destruetion or dysfunetion of neural tissues beeause 
with eaeh neuron funetion lost, maintaining system set points requires even greater seeondary risks; and 4. 
Slowing progression may therefore lie in mitigating the primary risk’s effeet on system set points or in 
limiting seeondary risks ineurred by inherent eompensatory dynamies. 


2 INFORMATION BASED EXCHANGE BRAIN MODEL 

2.1 Cytoarchitectonics of Bidirectional Neoeortieal Projections: The “Grand Loop” 


We propose a model that emphasizes a speeifie eortieo-eortieal eonneetivity aeross the major sensory, 
limbie, and motor eategories of Brodmann areas. This emphasis derives from several observations. First, we 
note the importanee of signals traversing all three eategories of eortieal representations in order to produee 
a stable basis for pereeption and behavior by integrating information about the environment, internal needs, 
and behavioral opportunities of the organism. While many loops have been diseovered in studies of the 
neoeortieal eonneetome, none provide the direeted graph (feed forward vs. feedbaek) needed to identify a 
system to support sueh traversals. Instead, we note that the eytoarehiteetonie granularity of neoeortieal 
areas provides one means to interpret feed forward (i.e., more granular to less granular) and feedbaek (i.e., 
less granular to more granular) eonneetions between eortieal areas [ |Rempel-Clower and Barbas[|2000| and 
therefore a means to identify a baekbone for global brain traversals (Fig. [^). 
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Granularity refers to the density of punctate Nissl bodies in stained layer 4 of neocortex. The granularity 
across all of neocortex was studied and mapped extensively by von Economo |von Economo[ 19291, and 
we reproduce his illustrations and some key findings in Eigures[^ and[^. Note that granular cortices 
typically have smaller diffuse Nissl bodies in layer 5, and agranular cortices have very large diffuse layer 
5 Nissl bodies. Tiling in von Economo’s map shows that regions of cortex with similar granularity are 
adjacent, with key exceptions at the boundaries between primary motor (Ml) and primary somatosensory 
(SI), hippocampus (HC) and retrosplenial granular areas (RGA), and subgenual anterior cingulate (ACC) 
and prefrontal (PEC) cortices. Each of these three pairs of Brodmann areas are interconnected, and in our 
model represent key boundaries in the backbone for traversing the sensory-limbic (HC-RGA), limbic-motor 
(ACC-PEC), and motor-sensory (Ml-Sl) cortices (Eig.[^, black arrows). To complete a “Grand Loop” 
backbone, we join each pair of areas by an area in their adjacent dysgranular neocortical regions: the 
secondary somatosensory (S2), posterior cingulate (PCC), and supplemental motor (SMA) areas (Eig. 
[^). While others have noted that organizing principles for intrinsic microcircuits may be derived from 
combining von Economo’s observations with those regarding granularity and the direction of cortico- 
cortical projections | |Beul and Hilgetag[|2015| , none to our knowledge have proposed a Grand Loop that 
traverses all of neocortex according to these principles. 

2.2 Cortico-Cortical and Cortico-Thalamo-Cortical Functional Pathways 


Having defined the feed forward neocortical Grand Loop, we’ll now embellish this structural model with 
additional components based on observations regarding feed forward projections and signaling between 
neocortical areas. Sherman and Guillery emphasized different roles for direct cortico-cortical feed forward 
projections, which join one cortical area to another primarily through their supragranular layers, and 
indirect cortico-thalamo-cortical projections, which join infragranular layers of the same original area to 
the granular layer of the same target area (Fig.|^, [ Guillery and Sherman[ 2011 j. In Sherman and Guillery’s 
model, direct cortico-cortical projections are “modulatory,” providing restricted activation to the target 
area, and indirect cortico-thalamo-cortical projections are “driving,” providing activation across all layers 
of the target area. Figure [^represents Sherman and Guillery’s model (based on a simplification of their 
schematic). We will now describe how this model may be integrated with the Grand Loop. 

Recall that each station of the loop in Figure [T]is coupled in the feed forward direction. These connections, 
largely through the supragranular layers, are mirrored in the feedback direction by connections through 
infragranular layers (Fig. j^, [Rempel-Clower and Barbas 2000 j. Thus the Grand Loop represents two 
reciprocal loops, one in the feed forward direction and one in the feedback direction. Furthermore, according 
to Sherman and Guillery, higher order thalamic nuclei provide at every stage a redundant relay for driving 
inputs over each feed forward connection. The local cortical circuit then receives signals from these 
thalamic nuclei and mixes the otherwise independent direct feed forward modulation loop and feedback 
traversal loop, primarily at layer 4’s synaptic connections onto supragranular layers, and at supranular 
layers’ onto the infragranular layers’ apical dendrites. 

We proposed previously that layers 2/3 of neocortex implement a network for maximizing mutual 
information between thalamic inputs and cortical responses |Kozloski et al. 2007 j. Entropy maximization 
in these layers (equivalent to information maximization when noise in the inputs is assumed to be negligible) 
would require a dense lateral network [Linsker 1997 j, which fits well with the high proportion (~ 22%) 
of total cortical synapses dedicated to intralaminar 2/3 connections [Binzegger et al. 2004 j. Given this 


role for the supragranular layers, we now propose that the role of driving inputs in Sherman and Guillery’s 
model is to provide inputs both from first order thalamic nuclei about the environment and from feedback 
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traversals about the behavioral state of the organism into a global supragranular network that extraets 
maximally informative features from their combinations. In addition, we propose that these features become 
conditional modulators on feedback traversals by boosting or reducing the gain on proximal inputs to layer 
5 neurons by means of synaptic inputs onto their apical dendrites from Layer 2/3 neurons. 

2.3 Basal Ganglia Gating of Feed Forward Functional Pathways 


In Sherman and Guillery’s model, thalamic relay neurons in both first order and second order nuclei 
are subject to modulation. Modulation may derive from direct cortico-thalamic feedback from layer 6, 
inhibition from the thalamic reticular nucleus, or from neuromodulatory inputs such as norepinepherine 
from the locus coeruleus. Sherman and Guillery’s model derives largely from their studies of sensory 
cortices and feed forward pathways through them, projecting from more granular to less granular regions. 
Here we extend the discussion of thalamic relay neuron modulation to include a role for inhibitory inputs 
from the basal ganglia to thalamic nuclei that act as relays in the frontal lobe between more granular limbic 
and motor areas to less granular areas in these regions. 


The basal ganglia (including ventral limbic and dorsal motor) are in a privileged position to influence 
traversals by means of their inhibitory inputs onto thalamic relay neurons in the Grand Loop. These inputs 
derive from nucleus inominata in the ventral limbic subpallidum and from the globus pallidus in the dorsal 
motor subpallidum. Neurons in the ventral pallidus (nucleus inominata) receive inhibition from medium 
spiny neurons (MSNs) in the nucleus accumbens (ventral striatum) and those in the dorsal globus pallidus 
from those in the dorsal striatum. These neurons then either directly disinhibit thalamic relay neurons 
or indirectly inhibit thalamic relay neurons through an additional stage of inhibitory neurons (in globus 
pallidus, this is organized as direct and indirect projections through the external and internal segments). 


Spiking models of inhibitory pallidothalamic gating have focused on the bird song system [Goldberg 


et aL| 20121, where gating inputs to thalamic relay neurons serve the role of transitioning syllables of the 


organism’s vocalizations. Here we propose a more generic role for this gating in selecting and deselecting 
different pathways for internal traversals. 


Inputs to these direct and indirect pathways through basal ganglia derive from neocortical layer 5 neurons’ 
projections onto MSNs, and their corticostriatal synapses undergo spike-timing dependendent plasticity 
(STDP) which is modulated differentially by dopamine depending on the selective expression of either D1 
dopamine receptors in the direct or D2 dopamine receptors in the indirect pathways (Fig. |^, [Pawlak and 


Kerr[ 2008[. Each layer 5 neuron’s collaterals then include a branch descending to the brainstem or spinal 


cord, a branch descending to thalamus JGuillery and Sherman 20111, and additionally a branch descending 
to striatum [ Levesque et al.[ 19961. A recent review of additional types of layer 5 projection neurons and 
the role of corticostriatal connectivity in disease provides a thorough examination and schematic of these 
pathways [ Shepherdl 20131, and our model of thalamic gating, for now and for simplicity, includes only 
the “Pyramidal Tract” layer 5 neurons and their projections to basal ganglia and thalamus for the function 
of thalamic gating. 


In summary, our model extends Sherman and Guillery’s model of cortico-thalamo-cortical gating of 
driving, feed forward inputs to include modulation from striatal and pallidal neurons in both the direct 
and indirect pathways (Fig.[^. MSNs in our model receive convergent layer 5 collaterals from all layer 5 
neurons that send convergent collaterals onto a specific thalamic relay neuron. This relay neuron is then 
gated by the same MSNs, indirectly through globus pallidus (the gate opens for the direct pathway, and 
closes for the indirect pathway). Such a scheme does not preclude so called “closed loops” that originate and 
terminate in the same cortical area [[Kelly and Strick[[2004|, but downplays their significance as only partial 
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regulators of feed forward thalamie gating (Fig.|^). The basal ganglia in our model is then a “forward 
driver gate” for all feed forward driving signals relayed through the frontal lobe’s eortieo-thalamo-eortieal 
funetional pathways. Beeause these pathways relay layer 5 traversals through thalamus to the granular and 
supragranular layers of eortex, they ean indireetly eontrol the routing of feedbaek signals and the seleetion 
of certain traversals over others through the Grand Loop, as we describe in the next section. Additional area 
to area cortico-thalamo-cortical pathways not on the main loop backbone (such as the visual system) are 
then available for additional modulation and traversals of the global layer 5 behavioral network, possibly 
including loops requiring reafference from the environment. 

2.4 Information Based Gating of Feedback Traversais 


Our model provides two distinct functional signaling pathways through the Grand Loop: feed forward 
for driving the supragranular entropy maximizing network, and feedback for traversal of the infragranular 
behavior generation network. The latter, in our implementation of the model, propagates synfire events 
through a loop, as described by Zheng and Triesch in their model of “synhre ring” formation and propagation 
[Zheng and Triesch] 20141. Restricting synhre activity to the feedback direction is a key aspect of our model. 
Unlike other models of feedback which ascribe to it solely a sensory processing “top down” function, we 
model the propagation of feedback activity as potentially independent of feed forward activity (for example 
when a coupling parameter between these two networks is zero). Specihcally, the emergence of activations 
in the supragranular layers are rate coded, while activations in the infragranular layers are spike timing 
based in order to support synhre events. (We won’t speculate here on how these distinct coding schemes are 
implemented and maintained by the neocortical microcicuit, but it would seem there are ample mechanisms 
available.) 

Conditional coupling between features, extracted by information maximization in the supragranular 
layers, and spike propagation in the infragranular layers is then under the control of a parameter that 
models cholinergic modulation in neocortex. Acetylcholine enhances the inhuence of sensory input on 


pyramidal cell bring relative to their processing of intrinsic signals within neocortical circuits [Hasselmo 
and Giocomo[ 20061. We model this modulatory parameter as changing the slope and dynamic range of the 
gain function on feedback integration within the synhre ring, such that feature encoding acts as a gate for 
synhre propagation. As we noted above, this gain function may be implemented by layer 2/3 inputs to 
layer 5 neurons’ apical dendrites. The result is that propagation of synhre activity through a column of 
cortex is informed by the categorization of thalamic inputs to that same area. Information maximization 
among responses in the supragranular areas over environmental inputs becomes entropy maximization of 
synhre propagation pathways through the infragranular layers, provided that coupling between these is 
strong (i.e., cholinergic modulation is high). It is because of this coupling that we have named our model 
an information based exchange network. 


2.5 The Forward Driver Gate: Bursting, Moduiation, and Piasticity 


Having proposed a central cortico-thalamo-cortical routing function for striatal MSNs by means of their 
directly disinhibiting or indirectly inhibiting thalamic relay neurons, we will now propose on what basis a 
striatal MSN adapts to perform this function in the context of system set points. We call this the forward 
driver gate’s “routing function.” Our model of MSN bring includes constraints from a weak, assymetric 
lateral inhibitory network giving rise to “winnerless competition” [Rabinovich et al.[|2001[, and closely 


matching the periods of striatal bursting lasting hundreds of milliseconds observed in vivo [Miller et al.[ 


20081. Ponzi and Wickens have similarly used this network to model spiking properties of striatum [Ponzi 


and Wickens 20101, and have shown that at transition points in the lateral network conhguration (from low. 
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~ 10%, to high, ~ 20%, rates of connectivity), an optimal balance is achieved that facilitates winnerless 
encoding of variations in driving inputs from neocortex |Ponzi and Wickensj 20131. To achieve this balance, 
our model instead varies the strength of cortical inputs dynamically by a dual source of modulation of 
STDP at the corticostriatal synapse. 

The first dynamic modulator of STDP at the corticostriatal synapse in our model is GABA inhibition 
from the lateral network, itself responsible for “turn-taking” among MSNs and their bursts, characteristic 
of the winnerless network. We assume that both direct and indirect pathways show STPD reversal under 
GABA inhibition |Fino et al. 2010 Paille et ^ 2013[ , and we model winnerless competition between 
striatal neurons as the source for this inhibition (Fig.|^). 

The second dynamic modulator of STDP at the corticostriatal synapse is dopamine. Given the routing 
function’s potential as a critical determiner of the emergence of behavior, affect, and cognition in the 
organism via its direct control over traversals of the layer 5 network, reward-based learning of this 
function is ultimately required. For now, we simulate our brain model of information based exchange 
with dopamine-based learning serving only a closed-loop function, separate from the environment and 
therefore independent of reward encoding. This closed-loop function is sensitive to system set points 
and monitors traversals. It is equivalent to so-called “tonic firing” in dopamine neurons, which can also 
include bursts. We propose that the intrinsic dynamics of dopamine neuron membrane currents implements 
this closed-loop function by measuring time and the abruptness of changes to system states, with bursts 
generated under specific conditions summarized below. Dopamine provides a potent modulation of STDP 


at the corticostriatal synapse [Pawlak and Kerr 20081, and further modulates it differentially at the inputs 
to Dl-MSNs and D2-MSNs. In our model this differential modulation, combined with GABA modulation, 
produces the complex routing function summarized in Figure]^. 

To signal basal reward inputs to the organism, dopamine neurons have been shown to fire bursts of action 
potentials in response to strong excitatory inputs to medial tegmentum and substantia nigra pars compacta 
(SNc). Because of these responses, the dopamine system has been extensively modeled as recapitulating 
reinforcement learning and operant conditioning in the organism. We propose here for the first time an 
additional closed-loop role for dopamine neurons in learning routing functions and selecting traversals. 
Specifially, we propose that dopamine neurons signal changes to traversals, and thereby influence the 
subsequent emergence of new traversals. The basis for this proposal derives from recent connectomics 
studies, which demonstrate that fully 70% of dopamine neuron inputs are inhibitory, and that most of this 
inhibition arises from striatum [ |Watabe-Uchida et aL| 20121. Our closed-loop role for dopamine modulation 
depends on this inhibition, and this proportion and source suggests that closed-loop responses to inhibitory 
inputs, not open loop responses to basal excitation and reward, may be the predominant operating mode of 
the dopaminergic system. 


Dopamine neurons exhibit heterogeneous combinations of intrinsic l^ and 1 a currents [ [Amendola et al.[ 
2012] , as well as T-type calcium currents, which together generate post inhibitory rebound bursting in 
slice preparations. These currents’ role in vivo has not yet been demonstrated, but our model assumes that 
the dynamical criteria for dopamine neuron bursting (and subsequent learning of routing at corticostriatal 
synapses) are implemented by rebound bursting. Other models have explored rebound bursting in dopamine 
neurons [ Lobb etH!]|2011| , but not in the context of a closed-loop regulatory function. In our model, 
if the duration and abruptness of removal of striatal inhibition to dopamine neurons is appropriate, a 
rebound burst occurs. This aspect of the model indirectly imposes the additional criterion that inputs 
from layer 5 to striatum that transition the MSN winnerless network should be similarly matched to the 
duration and abruptness of change required for rebound spiking in dopamine neurons. In this way the 
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striato-nigro-striatal loop monitors changes in traversals and alters routing within the feed forward entropy 
maximizing network by modulating corticostriatal STDR We therefore propose that MSNs learn this 
routing based in part on their ability to recognize patterns of spiking in layer 5 that remain stable for a 
minimum duration of time then fade rapidly, a property expected during traversals of the Grand Loop. 


3 SIMULATION METHODS 


We simulated the model to explore its dynamics, characterize preliminary set points for measurement and 
analysis, and study traversal behavior and it’s regulation under different modulatory conditions. The five 
major components of the model to be simulated included cortical layers 2/3, 5, thalamus, striatum, and 
dopamine neurons. Meeting this challenge at the detailed level of neural tissue simulation is beyond the 
scope of this report, and without a good understanding of target model set points, likely impossible. We 
therefore aimed to draw upon four simplified abstractions of the key behaviors we aseribe to prineiple eells 
in these structures [Linsker \991\ Zheng and Triesch} 2014 Rabinovich et al.[ 200 1[ Mihalas and Niebur 


20091. With four base eomponent models replicated from other studies, we then eoupled them aeross novel 


interfaces, realizing the closed, functioning Grand Loop, complete with its subcortical regulators. 

3.1 Component Models 

Four component models from the literature were targeted here to capture the functions of cortical layers 
2/3 and 5, striatum, and dopamine neurons in the brain model. These four met sufficient requirements to 
implement information based exehange, with very few ehanges to published parameters. We list the models 
below and describe the requirements they satisfy. Parameters defined in the original references for each 
component model are found in Table Because thalamic relay neurons were implemented as a simple 
set of sums over inputs, they are described as an interface between component models in the subsequent 
section. 


Neocortex, layer 2/3: The model applies the “Infomax” algorithm [Bell and SeJnowsHj 1995 1 to 


thalamic relay neuron inputs. A neural network implementation of the same optimization [Linsker 


19971 based entirely on a local learning rule, establishes the biological plausibility of this function 


[ Kozloski et al.[ 2007 1 . In brief, the algorithm takes the full rank weight matrix C and inverts its 
transpose to eompute a Hebbian learning rule with the term ((7^)“^ for entropy maximization over an 
ensemble of input vectors a; G X to a neural network. The input vector x is offset by xq to have zero 
mean. The output vector of the network Cx is transformed by the learned offset yo and a nonlinear 
logistic function to becomes the layer 2/3 area’s output y G (0,1), which maximi z es the mutual 
information over the input ensemble. The input offset, the offset of the neural network output, and the 
weight matrix, are each updated with learning rates /3xq , /Syp, and jSc (Table [T). 

Neocortex, layer 5: The model evolves from a self-organizing recurrent network of binary spiking 
units through application of homeostatic plasticity, weight normalization, and STDP learning rules. 


together with synaptic pruning and synaptogenesis [Zheng and Triesch 2014|. This biologically 
consistent set of synaptic modifications creates distributions of synaptic densities and weights that 
evolve over time to closely match data from developing neocortex. The weight matrix W also develops 
robust feed forward motifs and synfire activity similar to the model of Kozloski and Cecchi[ [ 20T0| , but 
with the remarkable topological feature of a closed, global loop of distinct propagation layers (Fig. 
[^, which together engender “synfire rings.” We evolved this network for 200, 000 time steps (A/ = 1 
msec) to create four areas of cortex, which were then embedded into the larger model as two frontal 
lobe (Ml, Msup) and two sensory lobe (Si, Ssec) areas. Weights close to zero were held at zero for the 
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Table 1. Component Models and Parameters 


Component 

References 

Parameter Name 

Parameter Value 

Neocortex, layers 4 and 2/3 

Bell and 

Seinowski 1)19951; 

Pxo 

0.00002 


Lmsker 

199/1; 

Pyo 

0.0007 


Kozloski et al.||2007| 

Pc 

0.0007 

Neocortex, layer 5 

Zheng and Triesch||2014) 

Pip 

0.01 




rpE 

^ max 

1.0 




TI 

max 

0.5 





0.1 




Chip 

0 




Pinhib 

0.001 





0.01 




PSTDP 

0.004 




PiSTDP 

11.0 


Striatum 

Rabinovich et al. 

|200T1 

5'max 

0.25 




,^min 

0 




a 

0.7 




b 

0.8 




Tl 

0.08 




T2 

4.1 




y 

-1.5 




Xq 

-1.2 




Vo 

-1.62 




Zo 

0 

Dopamine Neurons 

Mihalas and Niebur 

12009) 

h 

1.0 




GjC 

50 




ki 

200 




k2 

20 




©inf 

-0.05 




Rl 

0 




R2 

1.0 




El 

-0.07 




Vr 

-0.07 




Qr 

-0.06 




a 

1.0 




Ai 

5.0 




A 2 

-0.3 


remainder of all simulations. Propagating activity is maintained in the excitatory network, satisfying 
the requirement for layer 5 traversals. An inhibitory network that undergoes biologically plausible 
inhibitory STOP at its synapses onto excitatory neurons, together with homeostatic plasticity in the 
excitatory network, maintains activity in the synfire ring at a nominal firing rate of 100 spikes/sec. The 
inhibitory network imposes global, persistent competition across the network of excitatory layers. We 
propose this inhibition as an approximate functional model of inhibition from the thalamic reticular 
nucleus, which also integrates activity from across the thalamocortical system. 


Striatum: The model creates activation paths within the state space of a weakly connected, asymmetric 
inhibitory network to give rise to “winnerless competition” [ Rabinovich et al.[ 20011, and alternating 
bouts of activity among the different neurons in the network (Fig. These bouts have been used 
by others to model the intrinsic dynamics of the striatum jPonzi and Wickens 2010 j, and together 
represent global attractor states that encode the modulatory and reorganizing influence of excitatory 
inputs to the network from cortical layer 5. Using a FitzHugh-Nagumo model, MSNs are represented 
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by three dynamie variables. First, Xf{t) in the model represents the “burst potential” of the neuron, 
with a positive transient in this potential representing a ~ 350 msee burst. Computed using the same 
time step as the binary spiking layer 5 model, this eoarse resolution model of the neuron’s membrane 
potential is appropriate given the dominant bursting mode of firing in MSNs, and the observation that 


aetivity is often observed as alternating series of bursts of bursts JMiller et al.[|2008] |. The remaining 
variables yf{t) represent a reeovery from inhibition and Zf{t) the inhibitory synaptie eurrent reeeived 
by the neuron, summed over the inhibitory inputs from other neurons through a heaviside step function 
and the inhibitory weights g. 

Dopamine Neurons: The model is that of a leaky integrate and fire neuron. Four state variables are 
computed: a membrane potential V{t), a variable threshold 0(t), and two intrinsic currents Ii{t) and 
hit), each integrated over the same time step as the previous two models. Because spikes in this model 
are represented by instantaneous resets of each variable at V(t) > 0(t), the time step (At = 1 msec) 
is sufficient to integrate the neuron’s spiking dynamics. Based on the published model, we derived an 
instance of a “rebound burst” model, and satisfied the requirements of dopamine neurons in the closed 
striato-nigro-striatal loop. Specifically, the voltage-dependence of 0(f) permits the model to generate 
rebound spiking under conditions when the neuron has been hyperpolarized deeply, or for a prolonged 
period (Fig. |^. Due to the independent spike-induced current R 2 , each rebound event generates a burst 
of four action potentials. This simplification’s phenomenology also approximates that generated by 
other more complex models of rebound firing in dopamine neurons |Lobb et al. 2011[. 


3.2 Component Model Interfaces 


The interfaces between component models that create the integrated brain model of information based 
exchange are now listed and described. 


Feedback Cortico-cortical: Layer 5 feedback inputs to a cortical area layer 5 are modeled as in the 
self organizing recurrent network of Zheng and Triesch [20141 to implement the traversal network. 
Inputs are also categorized by the layer 2/3 model as an input vector of sums of binary spike trains over 
a time window tx- This vector xfb(^) comprises the elements XFBi(^) ^ Y^t-rx ^FBiiT), where 
SFBiiT) G {0,1} is the spike train from one unit in the upstream layer 5 area. Because of the full 
rank requirement of the information maximizing algorithm, the model of layer 2/3 includes a fixed 
first stage random mixing matrix Mfb, drawn from a lognormal distribution with unit mean and unit 
standard deviation, which linearly combines the elements of xfb to create the feedback input vector 
XFBit) ^ Mfb ■ XFBit)- 


• Feed Forward Cortico-thalamo-cortical: Inputs to a thalamic relay neuron j projecting to a cortical 
area are modeled as a vector of sums over a time window tx of binary spike trains from layer 5 
units in the cortical area projecting in the feedforward direction to the same area. This vector XFF(t:) 
then comprises elements XFFi(^) ^ Yt-rx ^FF^iT)^ is similarly transformed by a mixing matrix 
such that the thalamic relay neuron’s activity 6 *ff(^) ^ Mff ■ XFFit)- Each element 6 *fFj (^) is then 
subjected to the forward driver gating vector G, such that elements of the feed forward input vector are 
XFFjit) ^ Gj ■ Off jit)- 

• Layer 4 Thalamic and Feedback Inputs : Feed forward thalamic inputs to layer 4 are combined with 
feedback inputs, such that the input vector to information maximization in layer 2/3, x ■(— xfb + ^^ff- 
It is at this stage also that sensory inputs from a simulated environment may be added to the model. 

• Layer 2/3 to Layer 5: The Layer 2/3 output vector y provides an input to a gain function for layer 
5’s integration of binary spikes from feedback traversals of the Grand Loop. This gain function is 
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a model of the layer 5 neuron’s apieal dendrite, and is parameterized by the term Ach G [0,1], a 
proxy for the level of eholinergie modulation in neoeortex. The gain on inputs to layer 5 unit j is then 
Uj = [1 — Ach{l — yj)]/[l — Ach/2], whieh at Ach = 0, preserves unitary gain regardless of y, and 
at Ach = 1 provides a gain U G (0, 2) for y G (0,1). In this way, assuming information maximization 
divides the population into different halves of aetive and inaetive units, the total synaptie input to the 
network will remain eonstant, sinee the Uj will always have a mean of 1, and is applied multiplieatively 
to the exeitatory synaptie integration funetion of eaeh layer 5 neuron as in [ Zheng and Trieseh] 2014 j. 
Globus Pallidus to Thalamus: The forward driver gating funetion G G {0,1} applied to thalamie 
relay neurons in the feed forward eortieo-thalamo-eortieal pathway models the final output of basal 
ganglia, a transient inerease (via the indireet pathway) or deerease (via the direet pathway) in inhibition. 
G is eomputed using a modified pallido-thalamie adjaeeney matrix D, eomprising 1 for all direet 
pathway pallido-thalamie inputs, —1 for all indireet pathway pallido-thalamie inputs, and 0 for all 
uneonneeted pallidal to thalamie relay neurons. The bursting outputs of MSNs are represented by the 
half wave reetifieation funetion V, of the burst potential variable Xf{t), and the gating funetion is then 
written G = T-LlD ■ V{xf{t))], where "H is the heaviside funetion. 

Layer 5 to Striatum: The inputs from the Layer 5 model to an MSN in the Striatum model are 
drawn from all layer 5 neurons in the eortieal area for whieh the MSN gates inputs at the thalamus, 
and from those in the areas eonneeted to it in either the feed forward or feedbaek direetions. These 
Layer 5 inputs may also be direeted to motor outputs of the model to a simulated environment (as 
in the Pyramidal traet). Cortieostriatal synapses are subjeeted to STDP that differentially adjusts 
weights based on eorrelation between eortieal spiking and the derivative of the burst outputs of MSNs: 
V\xf{t)). Pre-post pairing is defined as when a eortieal spike oeeurs and this derivative is positive, 
and post-pre pairing when a eortieal spike oeeurs and it is negative. Eaeh kind of paring is eomputed 
separately and subjeeted to the modulatory eonditions at the synapse, as illustrated in Fig. Briefly, 
depending on 1. the identity of the MSN (Dl- or D2-type), 2. whether dopamine is or is not present 
at the synapse, and 3. whether the inhibitory synaptie eurrent Zf{t) at the MSN exeeeds a threshold 
izf{t) > 0.00707), eaeh pairing value may be either 1 or 0, and the adjustment to the weight a multiple 
of this value and a learning rate of 0.002. As in Zheng and Trieseh] | |20 14 j, weights are normalized 
sueh that the sum of all inputs to an MSN cannot exceed 0.1. When weights reach zero they are pruned, 
and new connections may then be formed during a time step with probability 0.2. 


Striatum to Dopamine Neurons: The input to each dopamine neuron in the model, Jg [Mihalas 


and Nieburj [2009 j, is computed by summing all burst potentials from those MSNs projecting to the 
dopamine neuron, multiplied by a constant weight of —2.25. 

Dopamine Release to Cortieostriatal Synapses: Unlike all other projections in the model’s interfaces, 
the dopamine neuron projection is to a synapse, not a neuron. Specifically, dopamine spiking results 
in a persistent dopamine modulation of STDP at a specific set of cortieostriatal synapses. Dopamine 
neurons are assigned randomly without replacement to cortieostriatal synapses onto each MSN. The 
duration of dopamine modulation following a Dopamine Neuron model spike persists at the synapse 
for a time tda- 


3.3 Simulated Experiments 


We simulated the model to explore the rate and heterogeneity of transitions in traversals and in subcortical 
modulators of these traversals. The configuration (Table allowed for a rapid prototyping because of 
the simulation’s small size. Following the initialization of the cortico-cortical Grand Foop network of 


This is a provisional file, not the final typeset article 


10 









James Kozloski 


Brain Model of Information Based Exchange 


Table 2. Configuration Parameters Speeifie to Model Simulation 


Parameter Name 

Description 

Parameter Value 

Na 

Number of cortical areas 

4 

Ne 

Number of thalamocortical units (layer 5, 2/3 pyramidal, thalamic relay neurons) 

400 

Tx 

Layer 2/3 integration window for spiking to rate code transformation (msec) 

100 

Ni 

Number of thalamic reticular inhibitory neurons 

80 

-^Frontal 

Number of frontal cortical areas under striatal gating 

2 

^Str 

Number of striatal MSNs 

100 

Acx.Str 

Number of cortical neurons projecting to a striatal neuron 

20 

^OCx,Str 

Initial corticostriatal weight 

0.005, (0.1/Acx.str) 

.^Str.Th 

Number of striatal neurons projecting to a thalamic relay neuron 

11 

Nba 

Number of dopamine neurons 

20 

Nstr.BA 

Number of striatal neurons projecting to a dopamine neuron 

20 

Tda 

Dopamine modulation window (msec) 

25,100 


four areas, we simulated the larger model for an additional 500, 000 iterations. The first 50, 000 iterations 
were used to adjust the biases of the layer 2/3 model, during which time Ach modulation of layer 5 was 
drawn from the positive half of a zero mean normal distribution with standard deviation of 1. All plots, 
except where noted, show the final iterations of the 500,000 total. Reported are experiments wherein the 
parameter tda was set at either 25 or 100 msec, and Ach at 0.25, 0.5, or 0.75. All plots except Figure [T^ 
show results for tda = 100 msec. 


4 SIMULATION RESULTS 

4.1 Coordinated Behavior Among Component Modeis 


Behavior of the model may be analyzed first based on inspection of various raster plots from different 
components of the model. In this way coordination between the different components is apparent. We first 
observed that cortico-cortical traversals through the feedback layer 5 network occur without subcortical 
regulation, and were similar to the synfire events reported by Zheng and Triesch [20141. There are two 
main regulators of these traversals in our model: 1. an information based gain on layer 5 feedback inputs 
provided from layer 2/3, and 2. basal ganglia gating of cortico-thalamo-cortical feed forward inputs to 
layer 2/3 information maximization by the forward driver gate. 


Upon introducing these regulators, we noted that traversals became structured into long bouts of smoothly 
alternating and repeating patterns of activity across the different cortical layers’ raster plots. Each pattern 
persisted for ~ 400 msec (Fig. [^), and sequences of patterns, while similar over each cycle, were not 
identical. The Ach parameter provides a means to adjust the influence of categories learned by layer 2/3 
on traversals. For this initial experiment, Ach = 0.25 provided a gain U G (0.86,1.14) for y E (0,1). 


Information maximization creates maximal entropy in the ensemble of output of vectors over an input 
ensemble, and because of the logistic function, activity in each layer 2/3 neuron was typically close to zero 
or one. We interpret these values as cortical up and down states, which have both an extrinsic and intrinsic 
origin in the local cortical microcircuit. 


Maximizing entropy of the ensemble of gain functions in this way, applied to layer 5 inputs in the 
feedback traversal network, had the interesting effect of creating more irregularity in the patterns of activity 
across all of cortex as Ach increased. At Ach = 0.5, U E (0.67,1.33), (Fig.[^), pattern combinations 
became varied, even though average global firing rates imposed by homeostatic plasticity in the network 
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were eonsistently maintained (100 spiked/see). Finally, at Ach = 0.75, U G (0.4,1.6), traversal transition 
rates inerease signifieantly, and patterns were highly varied (Fig.[^). 

Inspeeting the information bearing up and down states in layer 2/3 direetly in state rasters from all four 
eortical areas also reveals coordination between areas and with transitions in traversals. In Figure]^., 
under Ach = 0.25, the rate of state changes among layer 2/3 units appeared coordinated, especially in the 
secondary sensory area. This coordination is less regularly transitioned than in the traversals, and occurs 
at a higher rate. At higher Ach = 0.5 (Fig.|^) up and down state coordination with traversals increases, 
while coordination across layer 2/3 is weakened. At Ach = 0.75 (Fig.|^) states becomes synchronized in 
the secondary sensory area and more coordinated with traversals overall, even though traversals themselves 
become more heterogeneous. Note that the heterogeneity in traversals due to increased control by the 
information maximizing network is not due to a lack of convergence in the weights of the networks. 
Weights among both the layer 2/3 Infomax input weights C and layer 5 feedback weights W converged 
during these simulations. 


MSN bursts generated by the model were ongoing, as in the winnerless network and the model of Ponzi 


and Wickens [20101. These bursts appeared in fast sequences, which were of longer duration in Dl-type 


MSNs than D2-type (Fig. [T0| ). Variability in burst rate between MSNs was also observed, with some not 
bring at all, likely because of inhibition from the active network. Increasing Ach had only a small effect on 
the raster appearance, and so we began our quantitative analysis by examining coordination between the 
Striatum model and the Layer 5 model. 


4.2 Measurements of Information Based Exchange 


To quantify coordination between striatum bursting and cortical layer 5 spiking, we computed pairwise 
linear correlation coefficients between each cortical spike train and striatal burst train. We plotted each 
using a color scale (red, more correlated; blue, less correlated) in a matrix showing how different areas 
of cortex fired in relation to Dl- and D2-type MSN bursts (Fig. [m left column). Only significant 
correlations were plotted, and all others were represented by zero. We also show that the mean of each 
distribution of correlation values (Fig[^ right column) for both Dl- (blue) and D2-type (red) MSNs 
differed. Most coefficient distributions of Dl vs. D2 burst correlation with cortical spiking were signihcantly 
different(p < 0.05), based on pairwise student t-tests. More striking is the difference in sign for each mean 
coefficient of correlation to each cortical area as Ach increases. Positive correlation coefficients dominated 
at low Ach and negative at high. At the intermediate level. Ml in particular showed a divergence in sign 
between mean correlation coefficients for Dl-type (positive) and D2-type (negative) MSNs. 


Finally, to quantify information based exchange directly, we measured the entropy of cortical spiking 
and dopamine neuron spiking, and the mutual information between cortical and dopamine neuron spiking 
[ Strong et al.[ 1998[. Instead of measuring entropy and information among spike trains of individual 
neurons however, which quantify the distribution of patterns of spikes over time, we measured entropy 
and information in population spiking, which quantify the distribution of patterns of spikes over the 
population for single time steps. The method was aimed at asking if traversals themselves show entropy 
maximization based on increased modulation from layer 2/3. Synfire events are encoded by the sets of 
units that participate at every stage of the chain or ring propagation. Therefore, if the entropy of synfire 
population spiking increases, it can be concluded that the synfire chain entropy itself has increased. 


We found that entropy in cortical layer 5 population spiking increased as Ach increased (Fig.[T2|4). We 
also show that as the window of dopamine integration increased, the entropy of layer 5 population 
spiking increased slightly as well. Surprisingly, the entropy of dopamine neuron population spiking (Fig. 
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[T^) remained constant while both parameters in the model were altered. Finally, to measure how increasing 
traversal entropy depends on dopamine population spiking, we measured the mutual information between 
these two populations, and found it to decrease as Ach increased (Fig.[T2]f^). 


5 DISCUSSION 


We discuss the brain model of information based exchange in three contexts: brain evolution and 
development, brain resting state networks, and new approaches to the study of brain disorders such 
as neurodegenerative diseases. 

5.1 Brain Evolution and Deveiopment 


We propose that the Grand Loop, spanning sensory, limbic, and motor cortices, and specifically traversing 
in our model somatosensory cortices, is prototypical and embryonic in origin, since other modalities 
develop fully only after birth and do not share a granular-agranular tiling boundary in von Economo’s 
map. The topological relationship between other modalities and this backbone may then provide alternative 
pathways for completing a full traversal and rapidly binding percepts, needs, and behaviors. Finally, 
the tight coupling between somatosensory inputs and limbic states (i.e., tissue damage, pain) and motor 
states (i.e., sensorimotor feedback, proprioception) argues that this loop is likely preeminent in both brain 
evolution, organization, and development. 


This model additionally provides insights into those organisms lacking cortices, wherein the stages of the 
proposed traversals may not be segregated anatomically (e.g., into Brodmann areas), but instead may be 
nucleated (e.g., in the birdsong system), or even superimposed within the same pallidal regions (e.g., in fish 


and amphibians). Synfire ring development is robust given the synaptic modifications proposed by Zheng 


and Triesch [20141. It furthermore does not require anatomical segregation between layers to emerge, nor 


for synfire activity to propagate (e.g., for Fig.|^ we sorted each matrix after areas developed in order to 
illustrate them clearly and connect subcortical structures to each). 


Synfire rings may represent a prototypical substrate for behavior generation (Fig. 13), and through 
subpallidal regulatory inputs from thalamus and basal ganglia as described herein, for behavior selection. 
In such a scenerio, the evolution of a multilaminate neocortex to support such rings may have solved the 
problem of entropy maximization over the ensemble of synfire events in very large networks. Since the 
neural network implementation of Infomax requires a dense lateral network, to optimize each stage of a 
synfire ring and traversals in general would necessarily require segregation of stages and a superimposed 


information maximizing network (Fig. 13). This solution to the problem would support rapid expansion of 
the synfire ring substrate by evolution, given that redundancy in large networks could suddenly be managed 
and eliminated by information maximization. 


5.2 Resting State Networks 


The challenge of modeling resting state activity in the brain has presented itself based on observations 
that distinct networks spanning multiple cortical areas appear in imaging studies to serve either active 
or inactive states of the organism j jFox et ah 2005 j. Inactivity correlated networks appear even under 
anesthesia [ [Vincent et al.[|2007| , and these areas have very high metabolic rates, tipping the brain’s energy 
budget towards a large investment in the organism doing nothing. 


What this costly outlay accomplishes may be explained by our model’s use of closed-loop activity in the 
information based exchange network to increase entropy over the ensemble of traversals. In an evolutionary 
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context, this activity may be viewed as preadapting the brain to selecting novel behaviors in novel contexts 
by maximizing such a quantity first, before engaging with the environment, then using the diverse traversals 
to explore it and seek reward. 


While others have noted that resting state dynamics may represent a “constant state of inner exploration” 


[ |Deco et ^[|201H , our model is the first to assign a quantitative measure to the fruits of this brain activity, 
providing a new way to reason about the trade off between evolutionary pressures towards latent adaptive 
behaviors and the large metabolic cost of resting state network activity. 


5.3 Dynamic Disease Risk 


We hypothesize that basic controls are required to establish “cognitive homeostasis,” i.e., a process 
by which variables that change brain dynamics are carefully regulated so that properties of brain state 
transitions (and thus brain information processing and behavioral dynamics) remain relatively stable under 
constant neuromodulatory conditions. We refer to these stable properties as “set points,” i.e., targeted norms 
for critical system variables supporting normal behavior, percepts, affect, and cognition. In our model, 
these controls are based on a consistent set of parameters that yield consistent spiking and bursting patterns, 
even when the network undergoes reorganization (e.g., when Ach was modified, the system adjusted 
and produced stable traversals). Stable ranges of firing among burst rates and traversals, coefficients of 
correlated firing and bursts, and entropy and mutual information among population spiking and bursting 
have been our initial targets for describing these system set points using the brain model. 


In real brains, given evolutionary pressure for robust self-regulation and behavior, the system is certainly 
replete with controls aimed at maintaining these set points. The challenge of studying brain disorders such 
as neurodegenerative disease is sorting primary and secondary risks from the multitude of compensatory 
mechanisms, each of which manifests itself as a deviation from normal brain and neuronal function given 
some primary genetic or injury risk. Researchers have shown, for example, that mutant Huntingtin protein 
disturbs NMDA receptor localization, densities, and currents at the corticostriatal synapse in mouse models 
of the disease jCepeda et al.[ [200T] |. Knowing how this change arises and perturbs circuit dynamics, 
plasticity, and system set points may provide a better understanding of why certain neurons succumb and 
others don’t when subjected to the same mutant protein. 


We propose that perturbations in our model may result in stable dynamics, but with measurable 
risks related to stressors on normal neuronal function. If these risks are extreme in our model, and 
therefore difficult to compensate for in biological tissue, a cascade of neuronal dysfunction may result. 
Neurodegenerative diseases such as Huntington’s, Parkinson’s, and Alzheimer’s, may then be understood as 
cascading failures given initial stressors derived from plasticity abnormalities at the corticostriatal synapse, 
in the striato-nigro-striatal loop, and over the process of entropy maximization in layer 2/3, respectively. 
For example, subtle changes to STDP or homeostatic plasticity may result in increased synaptic competition 
or cycling in the space of possible weights, which is then difficult to compensate for locally, given that 
traversals entail global brain states. If these risks increase when stressed neurons are removed from a 
simulation, the model may then be used to predict disease progression. 


Implementation of the current brain model of information based exchange forms a framework for 
the analysis of cognitive homeostasis in disease using IBM’s scalable approach to structural and 
neurophysiological modeling of neocortex and brain nuclei [ Kozloski and Wagner[ 2011 j. Here we 
extend this approach and that of many brain modeling projects, which seem focused on validating complex 
local circuit and tissue models at the expense of validating tissue inputs. Minimal complexity brain models, 
in our case an information based exchange network, may be necessary to capture brain dynamics and 
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provide validatable inputs to complex tissue models. With this new approach, inputs and models of the 
various components may be validated against in vivo experimental observations and simulated over very 
long time scales in order to stress the model and its set points in physiologically and clinically realistic 
ways. 

Additional perturbations to the model may include physiological stimulation, such as simulated deep 
brain stimulation (DBS) in simulated neural tissue, drugs with known targets in the detailed model, and 
different disease states with hypothesized mechanisms at the level of gene, protein, regulatory network, etc. 
Stimulation, drug effects, and disease mechanisms can then be targeted to test certain hypotheses about 
modifications to dynamic disease risk, and to study the wider system’s behavior. Increasing complexity 
of perturbation sets (targets and combinations) may be designed to validate the model under different 
therapeutic conditions, and to test for phenotypic outcomes (e.g., symptomatology). 

In the above discussion, a model of several brain circuit components and their global set points is 
proposed as a means to test disease mechanisms and therapeutic inputs such as DBS and drugs. The 
implicit assumption of these tests is that risks can be inferred from outlier variables that maintain system set 
points, and that these outliers may then be implicated as causes of phenotypic symptoms such as abnormal 
behavior at the organismal, circuit, neuronal, or synapse level. Targeting these variables in real world 
systems is one approach we propose for novel therapeutic design and discovery using brain modeling 
combined with neural tissue simulation. 
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Figure 1. A. Granularity of different neoreortieal areas, adapted from von Eeonomo [ 1929 1. Colors at 
bottom eorrespond to the map in B. B. von Eeonomo’s neoeortieal tiling based on the granularity of large 
regions of neoeortex spanning multiple Brodmann areas. The loeation of three Brodmann areas per stage 
are waypoints along a feed forward Grand Loop (arrows). C. These Brodmann areas are eonneeted based 
on projeetion data. Evidenee that feed forward eonneetions progress from granular to agranular areas 
provides direetionality. The reeiproeal feedbaek loop is not shown. 


SUPRAGRANULAR 



Figure 2 . Organ ization of feedforward and feed baek funetional eonneetions, adapted from Guillery and 


Sherman [201 1||. Infragranular and supragranular layer pyramidal neurons (gray triangles) form direet 


feedbaek and feed forward eonneetions, with the loeal eireuitry reeeiving first order (FO) and higher order 
(HO) thalamie nuelei inputs through granular layer spiny stellate neurons (blue eireles). The basal ganglia 
(BG, pink boxes) reeeive infragranular inputs, and provide inhibitory gating to higher order nuelei in the 
brain’s frontal lobe. 
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Figure 3. The Forward Driver Gate. Cortical action potentials (red raster marks) traverse the Grand Loop 
(red circle, representing a periodic time line), when neurons in specific areas (red boxes) spike. These 
cause spikes in striatum, represented by STDP functions placed on a periodic time line for both the indirect 
(lavender circle) and direct (black circle) pathway medium spiny neurons (D2-MSN and Dl-MSN). The 
Dl-MSN is inhibiting the D2-MSN providing additional GABA-ergic modulation of STDP. Spikes cause 
direct disinhibition of the external segment of Globus Pallidus (GPe), allowing a cortical spike to be relayed 
through the thalamic gate (red arrows, SMA to Ml), or indirect additional inhibition through the internal 
segment (GPi), blocking spikes. 
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Figure 4. A. Schematic of cortico-thalamo-cortical routing. Direct (solid line) and indirect (dotted line) 
pathways through GP disinhibit or inhibit thalamic relay neurons. The striatum is a source of self inhibition 
(pink line) creating GABA-ergic modulation of corticostriatal synapses (pink annulus). Dopamine neurons 
in SNc receive extensive inhibitory striatal inputs, and similarly modulate these synapses (yellow annulus). 
B. GABA levels change with intrinsic striatal firing Strin and cross a threshold (pink box). GABA 
modulation results in changes to STDP due to correlated layer 5 (L5) and striatal (Str) firing pafferns. 
Superimposed dopamine modulation (yellow box), resulfs in disfincfly differenf STDP functions af a 
corticostriatal synapse (stars, corresponding to those in C.). C. For each combination of a direct pathway D1 
or indirect pathway D2 (rows) striatal neuron’s modulatory inputs, model STDP functions are represented. 
Transitions from low dopamine to high dopamine occurs from left half to right half of this matrix of 
functions. Transitions from low GABA to high GABA occurs between odd and even columns in the matrix. 
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Figure 5. A. C orrelation matrix compute d over the final 10,000 iterations of a simulation of the Layer 5 
model based onjZheng and Triesch|||2014|. The four self-organized layers of this cortico-cortical topology 
are correlated in firing. B. The cortico-cortical feed back weight matrix, showing clear dominance of the 
feed forward area to area connections over all others. This self-organized topology supports synfire ring 
activity, which in the current model is referred to as traversal activity. 
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Figure 6. A. Striatal burst potential time series derived from FitzHugh-Nagumo models of four MSNs 
(eolumns) plotted at the beginning (blue) and the end (red) of a simulation. Eaeh burst potential represents 
a series of MSN spikes fired in a burst. B. The time aligned burst output traees represent the half wave 
reetified version of the potentials in A. C. IPSCs reeeived by eaeh MSN (outward eurrents plotted as 
a positive defieetion). Currents are maximal when the neurons bursting eeases, and are low when it is 
bursting, refleeting the operation of winnerless eompetition in the lateral inhibitory network. 
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Figure 7. A. Long duration time series plots of Dopamine Neuron model variables. When the membrane 
potential (blue) reaehes the variable threshold (red), a spike reset oeeurs. Firing rates of Dopamine neurons 
aeross all simulations were eonsistently on average ~ 1.6Hz, and varied loeally depending up the ongoing 
integration of dynamie inputs. B. An expanded time seale reveals bursts (inset) oeeurring in response to 
deep hyperpolarization (single star), or prolonged weaker hyperpolarization (triple star) events. 
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Figure 8. Raster plots of the eortieal Layer 5 model outputs. 400 spike trains from the final 2 seeonds of 
simulated time. Cortieal areas noted on right. A. Under low Ach (0.25) traversals are long lasting (~ 400 
msee) and smooth. B. Under moderate Ach (0.5) traversals beeome briefer and ehoppy. C. Under high Ach 
(0.75) traversals are brief (100 — 200 msee) and heterogenous. 
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Figure 9. Up state (black) raster plots of Layer 2/3 model outputs (upper panels) and example time series 
of gain U on traversal inputs to each area (lower panels) A. Under low Ach (0.25), states transition more 
quickly than traversals from Fig.[^ B. Under moderate Ach (0.5), states transition more slowly in sensory 
areas. C. Under high Ach (0.75), up and down states become synchronized in the secondary sensory area. 
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Figure 10. Striatal model MSN burst raster plots over the final 100 seeonds of simulated time. Bursts 
eome in alternating bursts of bursts aeross the population due to winnerless eompetition. Dl-type and 
D2-type of MSN noted at right. Bursts of bursts are longer in duration among Dl-type MSNs under A. 
Low (0.25), B. Moderate (0.5), and C. High (0.75) Ach. 
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Figure 11. Pairwise linear eorrelations eoeffieients between eortieal spike trains and striatal bursts from 
Figs. and [T0| Only signifieant eorrelations are shown in the matriees plotted on left (Dl- and D2-types 
noted mongri^t) with others shown as zero. Mean eorrelation values are plotted on right, for Dl- (blue) and 
D2-type MSNs (red). A star indieates signifieant differenee {p < 0.05) in the distributions of eoeffieients 
(pairwise student t-test). A. Under low Ach (0.25), eorrelations are positive aeross motor areas and all areas 
eombined. B. Under moderate Ach (0.5), eorrelations beeome positive for primary motor Dl and negative 
for D2. C. Under high Ach (0.75), eorrelations are negative aeross motor areas and all areas eombined. 
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Figure 12. Entropy and mutual information computed for cortical and dopamine neuron population 
spiking. A. Entropy (H) of cortical population spiking for final 100 (dashed) and 200 (solid line) seconds 
of simulated time under increasing Ach. Circles plot simulations with tda equal to 25 msec and squares 
100 msec. In all conditions H increases with Ach and tda- B. Same as A, but showing entropy of 
dopamine neuron population spiking. C. With increasing cortical population spiking entropy (A.), the 
mutual information between cortical and dopamine neuron population spiking decreased. 
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Figure 13. A generalized sehematie for an information based exehange network. 
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